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(54)*Iitie: APPARATUS AND METHOD FOR IMAGE PROCESSION 
(57) Abstract 

A system for and methods of image processing are disclosed. The system comprises image acquisition apparatus for 
acquiring pixels of a digital image, permutation apparatus for receiving the pixels, for reordering pixels of the digital image into a 
plurality of abstracted images at a large reduction factor and for combining the abstracted images into many sets of abstracted 
imagescombmable into abstracted images at different small reduction factors and storage apparatus for receiving and for storm* 
the abstracted sets of digital images. One method comprises an efficient way of rotating images stored as abstracted images! 
other methods enable transformation between different storage formats. 
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APPARATUS AND METHOD FOR IMAGE PROCESSION 

FIELD OF THE INVENTION 

The present Invention relates to image storage methods generally and to permutations of 
pixel storage order in particular. 

BACKGROUND OF THE INVENTION 

Digitized Images are rectangular arrays of pixel data which are usually acquired serially from 
a scanning device. Some color scanning devices present a complete pixel at a time, comprising 
three colors, typically cyan, yellow and magenta; other scanning devices present, at one time a 
single row of partial pixels of one of the three colors, and alternate rows among the three colors. 

It is known in the prior art to store digitized images in sequential format The images are typi- 
cally stored on magnetic disks, in sequentially written blocks of typically between 512 and 8192 
bytes, where one block is the minimum number of bytes which can be read during one disk 
access. This block storage structure is only optimal when all the data accessed on each block 
Is utilized. For data scattered in parts of many blocks, access becomes expensive In thai many more 
disk reads are necessary to retrieve the desired Information than would be needed if the desired 
data were clustered in complete blocks. 

Computer memory is random access; sequential access and random access to computer 
memory each takes generally the same length of time which is typically much less than disk 
access time. Unfortunately, computer memory storage is much smaller than disk storage and thus 
cannot be used to store and to access digitized images of many Mbytes. 

Digitized images are usually displayed on Cathode Ray Tube (CRT) devices having a reso- 
lution of 75 - 100 pixels per inch. Since most scanners scan at a resolution of about 300 pixels 
per inch, displaying a digitized image requires a reduction of the volume of Information by a 
factor typicaDy varying between 9 and 16. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to utlDze the properties of both disk storage and com- 
puter memory to store digitized images. 

Therefore, there Is provided In accordance with the present invention, an image processing 
system comprising image acquisition apparatus for acquiring pixels of a digital image, permutation 
apparatus for receiving^ pixels subsequent to their acquisition by the image acquisition apparatus 
and for ordering the pixels, thereby to reorder the digital image and storage apparatus tor receiving 
and for storing the mutffcficity of abstracted images. 

Further, there Is provided in accordance with an embodiment of the present invention an image 
processing system comprising an image acquisition apparatus for acquiring pixels of a digital Image, 
permutation apparatus fer receiving the pixels subsequent to their acquisition by the image acquisi- 
tion apparatus and tor ordering the pixels thereby to reorder the digital Image Into a multiplicity 
of abstracted images at a reduction factor and storage apparatus for receiving and for storing the 
multiplicity of dbstr&rtecHmages. 

Additionally, there is provided In accordance with an embodiment of the present invention an 
image processing system comprising image acquisition apparatus for acquiring pixels of a digital 
Image, permutaBort apparatus tor receiving the pixels subsequent to their acquisition by the image 
acquisition apparatus, for ordering the pixels thereby to reorder the digital image Into a plurality of 
abstracted images at ar relatively large reduction factor and for combining the abstracted images 
Into a multiplicity of sets of the abstracted Images combinable Into a plurality of abstracted 
images at a plurality of different relatively small reduction factors and storage apparatus for receiv- 
ing and for storing the digital image in the multiplicity of sets. 

Additionally, in accordance with any of the embodiments of the present invention, the permuta- 
tion apparatus may comprise an apparatus for dividing the digital Image into a plurality of bands 
comprising a predetermined number of rows of the digital image and apparatus for operating on 
the plurality of bands in a band by band manner. The apparatus for operating operates separately 
on each band. 

Further, In accordance with any of the embodiments of the present invention, portions of the 
bands are written by the apparatus for operating to the storage apparatus when the portions of the 
band fiD at least one Ale system block. 

There Is provided In accordance with the present invention, an image processing method 
including the steps of acquiring pixels of a digital image, receiving the pixels subsequent to their 
acquisition in the step of acquiring and ordering the pixels thereby to reorder the digital image into 
a muftlpficity of abstracted images and storing the multiplicity of abstracted images. 

There is provided in accordance with an embodiment of the present invention an image pro- 
cessing method Including the steps of acquiring pixels of a digital image, receiving the pixels subse- 
quent to their acquisition in the step of acquiring and ordering the pixels thereby to reorder the digital 
image into a plurality of abstracted images at a relatively large reduction factor and combining said 
abstracted Image Into a multiplicity of sets of the abstracted Images combinable into a plurality of 
abstracted images at a plurality of different relatively small reduction factors and storing the digital 
image in the muitJpScity of sets. 
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There is provided in accordance with an embodiment of the present invention, an image pro- 
cessing method including the steps of of sequentially acquiring pixels of a digital image, sequentially 
receiving the pixels subsequent to their acquisition in the step of sequentially acquiring and ord- 
ering the pixels thereby to reorder the digital image into a multiplicity of abstracted Images at a 
reduction factor and of storing the multiplicity of abstracted images. 

Moreover, there is provided in accordance with the present Invention, an image transformation 
and rotation method including the steps of receiving an image stored In a permuted format, 
transforming the image in a permuted format to a tile format via an inverse transformation of the 
permuted format to a sequential format and via a forward transformation from the sequential for- 
mat to the tile format, of rotating the tile format image by rotating the location of each tile of the 
tile format im e, utilizing an amount of computer memory less than the image size and retransform- 
ing the rotated tile format image to the permuted format via an inverse transformation from the 
tile format to the sequential format and via a forward transformation from the sequential format 
to the permuted format. 

Further, in accordance with the present invention, the step of rotation includes the steps of 
receiving and buffering a number of tiles of a source image to be rotated, of writing to a storage 
medium a different number of tiles of a destination image that are fully defined by rotations of the 
buffered tiles of a source image, and repeating the steps of receiving and writing until the source 
image no longer contains tiles. 

There is provided in accordance with an embodiment of the present invention an image rota- 
tion method including the steps of receiving and buffering a number of tiles of a source image to be 
rotatec and of writing to a storage medium a different number of tiles of a destination image that are 
fully defined by rotations of the buffered tiles of a source Image, and repeating the steps of receiving 
and writing until the source image no longer, contains tiles. 

There is provided In accordance with the present invention, an image processing system 
comprising an image acquisition apparatus for acquiring pixels of a digital image, apparatus for 
dividing the digital Image into a plurality of bands each comprising a predetermined number of rows 
and permutation apparatus for operating on the plurality of bands in a band by band manner and for 
reordering the location of the pixels. 

Further, there is provided in accordance with present Invention, an image processing system 
comprising a storage apparatus for receiving and for storing the bands in a band by band manner. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

>■ • - . 

The present Invention will be understood and appreciated more fully from the following 
detailed description taken in conjunction with the drawings in which: 

Ffc. 1 Is a block diagram illustration of an image storage system using the Image storage 
method of Fig. 2B; 

Fig. 2A id a pictorial illustration of a sequentially stored image; 

Fig. 2B tea pfctorlal illustration of a permutation based image storage method con- 
structed and operative in accordance with the present invention; 

Fig. 2C fe a pictorial illustration of an alternative view of the permutation based Image 
storage method of Fig. 2B. 

Fig. 3 te>a Verm diagram illustration of the regions of overlap between muftiple abstraction 
levels useful in an alternate embodiment of Fig. 2; 

Fig. 4 isaplclorlalillustrattonpf an order for storing the regions of overlap of Fig. 3; 

Fig. 5 is a pictorial UlustraHdn of an alternative order for storing the regions of overlap of Fig. 

3; -;• 

Fig. 6 tea pictorial Illustration of a method for transforming an image stored in one format, 
or permutation, to an image stored in another format; 

Fig. 7 Is a pictorial illustration of a tile format permutation useful for rotating stored images; 

Fig. 8 te a pictorial illusion of a method for rotating images 90° using the tile format of 
Fig. 7; 

Fig. 9 te a pictorial Illustration of a method for rotating images 45° using the tile format of 
Fig. 7; and 

Fig. 10 te a pictorial illustration of a band permutation image storage method useful in 
the Image storage metbocHrf Figs. 2. 

DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT , 

Reference te flow made to Rg : 1 which illustrates an image acquisition and storage system 
using the image storage method of the present Inverttioa The system is based on a variation 
of standard direct memory address (DMA) techniques and comprises an image acquisition unit 110, 
typically a scanner or a CCD camera, for acquiring a digitized image and a scanner acquisition 
unft112/slmBarlnoperafonto a DMA controller, for receiving pixels of the digitized Image, forper- 
mutlng the addtesse^of the pixels within the digitized image according to the method of the 
present Invention, and for transmitting the permuted pixels to temporary storage in a computer 
memory 114. The system additionally comprises a Central Processing Unit (CPU) 116, such as the 
80386 microprocessor: torn Intel Corp., for directing the scanner acquisition unit 112. Since the 
computer memory 114 has a limited size, typically less than 10 Megabytes, which is generally 
significantly smaller man the size of the cflgiBzed image, typically in the tens of Megabytes, the 
memory 114 cannot hold the entirety of the permuted Image. Thus, the permuted pixels 'tem- 
porarily stored in memory 114 are typically periodically transferred to a storage medium 118, via a 
storage medium DMA controller 119, in parallel with the entering of other permuted pixels into 
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memory 114. The storage medium 118 Is operative for generally longer term storage. ' 

Scanner acquisition unit 112 permutes the addresses of the pixels according to a mapping 
transformation which typically is chosen to optimize frequent operations on the digitized image, 
such as reducing the size of the image in order to display it on a display device. 

The mapping transformation is typically a permutation of the seM={0.i.2,..tf-i} onto Itself. A 
permutation P is denoted i-*, where i is an element of the set of initial pixel addresses p- is a 
pixel address to which the ah initial pixel is permuted, known as a permuted pixel address' and N 
is the number of pixels in the image. Equation 1 presents a representation for the permuta- 



tion P. 

P = 



0 1 2 •■■ N-l] 
Po Pi Pi pn-i 



(1) 



The upper row of the notation typically indicates the initial pixel addresses i and is denoted 
T(Py, the lower row of the notation typically indicates the permuted pixel addresses p The nota- 
tion specifies that any untransformed pixels i (i.e. any pixels for which Pi =i) in the permutation p 
are not included in the representation, but they are present in the mapping. Moreover a per- 
mutation P operates on the entire digitized image. ' 

It will be understood that the permutational transformations are invertible and that they 
do not perform any compression or expansion of the image. 

The smallest set of sequential pixel addresses, known as an interval, that contains T(P) is 
typically called Fs band, b(P). For example, let C be the transformation given in equation 2. 

f20 351 



C = 



35 20 



(2) 



T(0 accordingly contains the addresses {20,35} and the band b(Q is the interval [20 351 A 
further example of a band *<P) is shown in Fig. 10 which illustrates a digitized image.'denoted 
120, organrzed into bands, denoted 122a-e. Each band 122, as mentioned hereinabove, is typically 
comprised of a predetermined interval of pixel addresses of the image 120. Moreover, the bands 
122 do not overlap with each other. 

Thus, it is possible to define norHJvertapping (i.e. having disjoint sets b(Pj) ) transformations 
Pi whose bands, for the example shown in Fig. 10. are I22a-e. it will be appreciated that the 
number of non-overlapping transformations depends on the number of bands 122 chosen and is 
typically denoted by i*. A transformation P for the entire image 120 is the product of the non- 
overlapping transformations P } as defined in equation 3. 

V (3) 

The transformations P s are typically related to the transformation P x by the addition of a 
base value c r If P, is defined by i-»p lf , thenP, Is defined by 

i+cj-^Pv+cj. j 4) 
In other words, each transformation p., is metrartformationP, shifted by the base value c,. 
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For example, the permutation 

fO 1 2 3 4 5 6 7 8 9 10 11 12 13 14 
E " 4 2 3 1 0 9 7 8 6 5 14 12 13 11 10 

can be written as the product of three non-overlapping transformations, 



(5) 



E = Ei-E 2 Ez = 



0 1 2 3 4] [5 6 7 8 91 flO 11 12 13 14 
4 2 3 1 Oj" [9 7 8 6 5j"[l4 12 13 11 10 



(6) 



The bands associated with each permutation Ej are the intervals 

M£i)=[0..4] 

fr(^2)=[5.5] (7) 
6<P 3 )=[MU4] 

The base values c s of each band is just 

ci =0; c 2 = 5;c 3 = 10 (8) 
The transformation £ can then be seen to obey equation (4) which In this case is written: 

i + cj^>e u + cj t (9) 

where e Xi o=4 t e u =0, ^=3, e 13 =l # e M =0. 

In accordance with a preferred embodiment of the present invention and as mentioned 
hereinabove, the scanner acquisition unit 112 receives a pixel value i, from location i of the digi- 
tized image 120 and stores the pixel value In permuted location of memory 114, where q h is 
the starting memory location for band 6. The permutation is typically performed according to a 
transformation Pj by an address generating routine G(P,), described in more detail hereinbetaw. 
Upon termination of the permutation of the entirety of one band 122, the portion of the permuted 
band and any previously unwrfiten portions of previous bands still stored In memory 114 which 
comprise an Integral multiple of blocks of data is written to storage medium 118. The remaining 
portion of the permuted band is typically wrftten to storage medium 118 only upon termination of 
the permutation of the next band 122. it is a feature of the present invention that the system of Fig. 1 
writes a block of data to the storage medium 118 typically only when the block of data is full. It is an 
additional feature of the present invention that the permutation operation does not significantly slow 
down the writing to the storage medium versus writing in a unpermuted manner. 

The acquisition and permutation of a second band 122 of pixel values can be performed in 
parallel with the wrile operation for a first already permuted band. This parallel reading and 
writing is known as double buffering. 

For a dou&le buffering scheme which neglects block size, of storage medium 118, memory 
114 is typically divided into two buffers. Each buffer is minimally the size of one permutation Pj. 
The size of a permutation is defined as the number of elements in a band. 

Forj-storage medium 118 organized In blocks, typically of a predetermined size B % the 
minimum size of memory 114 for a double buffering scheme is typically twice the size of the 
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permutations Pj phis twice the size B of one block. The addition of 2B is necessary because the 
bands may not be block aligned. 

It win be appreciated that the maximum data buffer size is principally dependent on the size 
of the band 122 and secondarily dependent on both the block size. B, and the anticipated location 
of the band on storage medium 118. It is not dependent on the complexity of the transformation. 

As mentioned hereinabove, an address generating routine G(P) is defined which generates 
the permuted location a in memory 114 for each pixel as ft arrives sequentially. The address 
generating routine G(P) is less general than the permutation Fin that the address generating rou- 
tine G(/>) is a routine which produces the permuted addresses sequentially, on successive routine 
executions, whereas the permutation P Is a transformation which wOl produce any permuted 
address given its address as an argument. 

According to a preferred embodiment of the present invention, the definition of the permu- 
tation P, and accordingly of permutation p x is typically chosen to reduce the number of i/o opera- 
tions necessary to perform common processing operations on the digitized image 120. For exam- 
ple, the resolution of a typical CRT monitor is 75 pixels per inch whereas the typical resolution of a 
digitized 8 1/2 in. by 11 in. image is 300 pixels per inch. Thus, typically only 1/16 of a stored image 
120 can be displayed at one time on an 8 1/2 in. by 11 in. CRT monitor. 

In order to display the Image 120. ft is typically abstracted by a reduction factor r. that is the 
dsplayed image includes every r th pixel of every r th row. For the abovementtoned example the 
reduction factor r Is set to 4. 

According to a preferred embodiment of the Invention, the permutation p is typically defined 
such that the full-size image is stored as r 2 smaller images, known as abstracted images, that each 
have l/r the number of both rows and columns. The full-size image is stored in the band structure 
described hereinabove where every band is organized into r 2 abstracted bands and where each 
abstracted band is written to the storage medium 118 as a continuous whole. An abstracted image 
can thus be read by reading only those blocks belonging to the abstracted bands comprising the 
abstracted image, it will be appreciated that the abovementtoned embodiment presents a savings 
of generally r 2 , neglecting disk granularity, over reading the entirety of the Image and subsequently 
abstracting It. 

Each abstracted image comprises every r th pixel of every r th row of the full-size image 
but the initial pixel of each abstracted Image differs among abstracted Images. If the leftmost and 
topmost pixel is defined two-dlrnensionaHy as pixel (0.0) where the location numbers increase to the 
right and down, the initial pixels are chosen from the pixels belonging to the square whose 
comers are the pixels (0.0). (0,r-i). (r-1.0) and (r-i.r-1). in other words, the abstractions differ 
by a two- dimensional phase. 

As mentioned hereinabove, each band 122 of the digitized image 120 is typically divided 
into r 2 abstracted bands where an abstracted band comprises only those elements of the band 
122 betonging to one of the ^abstractions. Moreover, the number of rows and columns of the 
band 122 are typically multiples nr and mr, respectively, of r. The size of the abstracted band 
is mn and the size of band 122 is r 2 times the size of the abstracted band, or mnr 2 . If enough 
memory 114 exists to store the entire image, n can be chosen so the entire image will occupy one 
band. 
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For each band, the Incoming pixels belonging to a single abstracted band are located, In 
order, in a single continuous area of memory 1 14. 

Equations (lOa-e) present the permutation equation Pi of the first band 122 of image 120. 

6 C = i mod t ( 10a ) 



rm 



modr 



K = 



i mod rm 



(10b) 



(10c) 



(10d) 



Pi = mn(B c +rQ r y + X e + mX r (iQe) 

Where L • • • J Is the floor function. In equations (Ha-e) e e is the column geometric phase of pixel f, 
e r Is the row geometric phase of pixel /. a. is the column within the abstracted band of pixel i K is 
the row within the abstracted band of pixel L Equations (11a-e) comprise the inversion formu'la for 
converting permuted indices into sequential indices. 



Pi mod rmn 



6r = 



nm 



Pi 



(11a) 



TttUV 



Ae = pi mod in 



K= 



Pi mod mn 



m 



(11b) 
(11C) 
(11d) 
(116) 

Software for the address generating routine, the permutation formula, and the inversion tor- 
mula, written Irrthe C++ language, are found in Annex A. The address generating routine is called 
next and the routine that produces the permutation function is called q. The address inversion 
generating routine Is catted inext and the inversion permutation function is presented in qlav A 
test program, called gatest, to check the the equality of the address generating routines and the 
address permutation functions, and code to check that the address inversion permutation function 
correctly Invert the address permutation function, are also included In Annex A. 

Note that,- although the address generating routine is complicated, ft requires no multiplica- 
tion operations, other than of constants which can be precompiled Thus, the address generating 
routine is typically fast enough topermute the address for a first pixel before scanner 110 acaulres 
a second pixel ^ 
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Rg. 2A Bkjstrates a sequentially received Image and Fig. 2B illustrates the abes******** 
permutation for some abstractions of one 1*16 band of £ a^hX 4 

The number ofrows nr In a single band is 12. where n is 3, and the nun^rotoolu^^b 16* 
where mis 4. Thus, the size mn of an abstracted band is 12 pixels. ' 

^Jr^LT^^ 06 ^ 16 8bStractedbands ^ each of the 16 abstracted 
^tL ^T 5*" X7 repre8entln9 te ""■» « Oeometric phaseTeach 

Rg. 2B shows sorrow the 16 abstracted bands. Five of the abstracted bands are labelled 
according to the abstracted Images A(x.y, to which they belong and toptote sC ^fCS 

^2C fflTSl c ^ S ^ ^ <* *• abstracted bands on the storage medium lia 

St^S ^Lf, ° VreWO ' lhe abstracted bands shown h Rg. 2B wherein each 
abstracted band is shown as a rectangle corresponding to the original full scale image shown (f^Rg! 

As merrtior^hereinab^.tfwpbcelsbetar^ to an abstracted bar* are stored in a con- 
tinuous area of memoryiu. if the pixel 0. the first pixel of the abstracted band bl^to^OoT 

r?7l J^" ,OCaBOn ° tebe " ed °" men wcond pixel of the abstracted band * Z 0 ' 
Pixel 4. is stored in memory location 1 labelled 1. The memory toc^^WiSx^^ 

tUT "fc!!!^ 00 " '* te ' s a^ 8 to' Bt ' to more than 1 memory location th^nttie^n^m^rv^o^a- 

bons indicated is understood to be multiplied by the number of memory focatZ need^TL^ 
pixel in actual rnemory address calculations. "canons needed to store a 

^r^^TJt 61 ******* tand * A(1>0) ' P^ 11 ' te ***** stored in the first location 

As mentioned hereinabove, abstracted images A<x.y) each comprise 1/r 2 of th» nh a i e m 
S^^EJ' a two^.mensiona, phase, it 1* seen fZ£ 2B 2 
a^hacted band I A(0.0) come from the first, fifth, ninth and thirteenth columns of the first War* 
rtnth rows of band 130 whereas the pixels of atetracted band Ap^) come from iteZ^ 
eighth, tweffth and sixteenth columns of the third, seventh and tweiftUws oTba^S,. 

For the exarnpte in Fig. 2B. for the pixel 73.1=73. Equations (10m) win give the results 6 -1 
e^O ^=2. X^l and ^=18. Pixel 73 Is in fact in the abstraction having the phase 7 oTa^ wiin 
as abstracted it is in column 2. row 1 (see Fig. 3C). Pixel 73 is in tneZ ^^J^S^Sl 

^r^ziT** n °- - — — - <"~> 

It wffl be appreciated that it imaoe 130 comprised more than one band, then the octets tehnm. 

hereinabove. R double buffering is used, the pixels belonging to a second band arestorea^r^the 
s»ndbu«« of memory 114 while the pixels already stored In the frstbuterare being ^21 Z 
storage medium 118, For Image 130 of more than one band./fc,) conpr^ ™reCn ,ne 
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one abstracted band shown with respect to Fig. 2B. 

An alternative embodiment of the invention defines the permutation P such that the digi- 
tized image is organized according to a multiplicity of reduction factors. For example, ft may be 
desired to be able to abstract an image at a range of small reduction factors 2, 3, 4, 5, and 6, 
rather than the fixed factor 4 h the previous embodiment To do so, a large reduction factor is 
found which Is the least common multiple of the entirety of small reduction factors. For the example 
given, the large redaction factor might be 60 since each of 2, 3, 4, 5, and 6 are factors of 60. If it is 
desired to store the Image according to the previous embodiment, the image would have to be 
stored as 3600 abstracted images. However the abstracted images of the different small reduction 
factors are not disjoint with respect to each other. Thus, an alternative embodiment of the present 
invention discloses a permutation P which facilitates access to the multiplicity of abstracted images 
at the small reduction. factors by utilizing regions of overlap between them. 

The following discussion uses an example of a large reduction factor of 60 but should not 
be construed to BmR the invention to that example reduction factor. 

To design the permutation P, the abstracted images at the smaller reduction factors are 
calculated from the 3600 possible abstracted images. An abstraction set S r is defined such that Us 
elements are pixels belonging to an abstracted image at reduction factor r which begins at the (0 0) 
pixel. 

The intersections of the five abstraction sets S 2 , S 3 , S 4 . S 5 and S 6 are shown in a Venn 
diagram in Fig. 3. A multiplicity of regions or subsets, denoted S a , ■ • - s k on Fig. 3, are shown. 
Subsets S 0 , S b , S e , S d , S s , S f , S t and S k are regions of overlap and belong to a muiapBclty of sets; the 
remaining subsets. S,, Sj and S k , are Independent regions which belong to the sets S 3 , s ' s and 
S 2 , respectively. Subsets S„ • ■■ A are defined as follows: 

S a =S 3 nS 4 nS s 
^ = (S 3 nS 4 )-Ss 

S/=((S 2 -S4)nS 3 )-5 $ (12) 
S, = (CS 3 nS s )nS 2 )-S 4 

S k = (S 3 nS s )-S 2 
S, = QS 3 -S2)-S S 
S, = iS 5 -S 2 )-S 3 
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Si =S| — S2 — S3 — Sg 

For example: the subset that is common to all sets is which is defined by equation 13, 

S a = (A(0,0)) {13) 

The subset S e is defined in equation 14, 

S e = {m20M(0,40), A(M,0), ,1<^^ (14) 

As can be seen from equations 13 and 14, the size of a subset is typically the number of 
abstracted images Afcj) at the large reduction factor which belong to ft. It wpl be appreciated 
that the s ^sets S„, • • • J k are not of equal size, nor do they as a whole include the entirety of pixels 
of the in. ,3 120. Table 1 presents the sizes of the subsets. 

The abstraction sets S it S 3l S 4 , S 5 and S 6 can be written in terms of the subsets of Fig. 3 
as follows: 

S 2 = S a u S b u S e u S d u S t u S r u S t u S k 

S 5 = S a \jS e vS t uS t \jS h \jSj (15) 
Sio = S a \jS e uS.vS t 



Table 1: Sizes of Subsets 



Subset 


Size 


Subset 


Size 




1 


s* 


3 


s b 


24 


Sh 


12 


S e 


8 


Si 


288 


s d 


192 


Sj 


96 




24 


St 


576 


Sf 


72 


Si 


2304 
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The subsets S a . • - • enable the Venn diagram to be be ordered in a linear fashion to 
allow fast access to specific abstraction sets. A variety of permutations utilizing the subsets 
S a , • • ■ ,S k can be performed; the optimal one will depend on the expected frequency of access to 
the various abstraction sets. One such ordering ensures that abstraction sets at smaller reduction 
factors which have more elements to them be less fragmented than the ones at larger reduction 
factors. 

According to a preferred embodiment of the present invention, the multiplicity of abstraction 
sets, S 2 , - ♦ • ,S 6 In the example, are stored in the band structure described hereinabove. The band 
size is typically at least nmr 2 where r is the least common multiple used to create the abstracted 
Images^CrjO. - 

Fig. 4A illustrates an example permutation of a band 122 which typically enables abstracted 
bands of the example abstractfon sets S 2 . s 3 ,$ 4 andS«to be read sequentially. lnFlgs 4B- 
4F the bold lines specify the subsets to be read to create abstracted sets S it • • • ,S 6 respectively. 
Abstraction set S 5 typfca|y cannot be read sequentially. An alternative embodiment of the Inven- 
tion, shown In Fig. 5, enafltes abstracted bands of abstraction setS 5 to be read in one sequen- 
tial read. A subset S 9 is created by replacing the pixels in the set S, « S e uS a vjSjvS t with pixels 
from the set S, which are located close to the pixels of set S,. For example, the approximation 
to the abstracted image A(0,0) is the abstracted Image A(1 ,0) which is in the subset S,. 

It will be appreciated that Figs. 4 and 5 are not to scale. 

The entirety of the image 120 is stored in bands 122. Thus, the abstracted band belonging to 
subset S t for each band 122 is typically stored in an area of both a buffer of memory 1 14 and of the 
storage medium 118 after the abstracted bands of subsets S a , ■ ■ ■ ,S k . Attentively, the abstracted 
band of subset S, can be used to block align the abstracted bands of subsets S a , • • • in the 
alternative embodiment, elements In one abstracted band of subset S, are located before and after 
the elements of the abstracted band subsets ,S k , located according to either of Ffes. 4 or 5. 
such that at least one frequently accessed abstracted band begins at the beginning of a storage 
medium block. . . 

The Image typically contains a multiple of r rows and r columns. An image that does not con- 
form to these constraints typically is expanded to conform. 

For an image which Is 8.5 Inches wide, scanned at 300 pixels per inch where each pixel is 32 
bits, the minimal number of rows for the example given herein needed to make a band Is 60 rows 
The resultant band typically occupies 597K bytes. The maximal expansion of the Image due to the 
abovementioned constraint is 1/5 Inch (60 pixels) in height and width and the average expansion is 
half this amount. 

In accordance with the alternative embodiment of the invention, an abstracted Image with 
reduction factor «, where »is a product of at least two of the factors r. can be read by reading the 
subsets which are common to thefactors which make up «. Thus, the abstracted image at reduction 
factor 1 0 comprises the subsets S a , S e , S„ and S t . 

If n is a multiple of one of the factors r, its abstracted image can be read by reading the 
abstraction set S r of which n is an integral multiple and further abstracting S r . For example, the 
abstracted image with reduction factor 9 is read by reading the abstracted image S 3 and further 
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abstracting it by a factor of 3. 

An abstracted Image with a reduction factor of n, where n is relatively prime with reference to 
the factors r or is not an integral scale factor, can be obtained by reading an abstracted 
image with a smaller reduction factor and the resampling the lower order abstracted image to 
obtain the desired abstracted image. For example, the abstracted image with a reduction factor of 
7 can be obtained by reading the abstracted Image S 4 interpolating by 7/4. 

It wfll be appreciated that the abovedescribed subset ordering and its inverse can be 
precomputed and stored in the scanner acquisition unit 112 in a lookup table. The lookup table win 
enable a fast calculation of the locations of the permuted pixels. Annex B contains a program to 
generate the permutation and its inverse for the multiple abstracted image permutation 
described hereinabove. This program makes use of the base class gabs defined in Annex A. 

Another example of a multiplicity of reduction sizes that is possible with the abovedescribed 
embodiment Is fixed power reductions. Typically a set of reductions that are successive powers of 2 
are needed, that is multiple reductions of order 2,43,16,32,... For example, if r is 64 the 
2,4,8,16,32,64 order reductions can be read from the storage medium in one access. Reduction 
factors of powers of 2 are useful in the pyramid transformation. The pyramid transformation and Its 
use is described in detail in the book, A. Rosenfeld. ed. Muldresolution Image Processing and Analysis. 
Springer-Verlag, Berlin, 1984. it should be noted that, in general, each pixel in the reduced order 
image of the pyramid transformation may be a complex mathematical transformation of the full reso- 
lution image data. The abovedescribed embodiment derives the reduced image pixels from a simple 
subsampDng of the original image. 

The permutation equations for the abovedescribed transformation are slightly different than the 
equations (lOe) and (He). Since the r* abstracted bands are not stored in a simple oider dictated 
by the geometric phase, a mapping M(e r ,e e ) of each abstracted band is needed in order to compute 
the transformation; This mapping returns the sequential Index of the location of the abstracted band 
A(e„e 4 ) whhln the subset ordering as illustrated in Fig. 4A. Equation (lOe) is then replaced by 
equation (16) for :.iis transformation. 

Pi = mnM- l (e e ,e r ) + ^ + ml,. ( 16 ) 
Equation (He) for the inverse Is replaced by three new equations (17a-c). 

y e = MQ,,*,) modr ( 17a) 

w(e c ,e r ) 



(17b) 



i = Tfc + mry r + r\c+ r^mK (17 C ) 

If the digitized image 120 is stored in a format defined by either of the permutations dis- 
closed hereinabove, or in any other non-sequential format, it typically can be transformed to 
another, more common, format for additional processing. A typical processing format is the 
sequential format For instance, the image 120 may be stored as abstracted images of reduction 
factor 4 and it may be desired to perform a convolution on the entirety of the Image 120. The 
sequential format is the natural format for this calculation. Thus, the stored abstracted image is 
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typically transformed Into the sequential format. This can be accomplished by simply transforming 
the data read from the storage medium 118 via the inverse of the transformation by which ft was 
stored, as shown in equation 18. 

P~ l =PT i -Pi ~-Pb ' (18) 

P- 1 Is typically performed on a first band of data in parallel with the reading of a subsequent band 
of stored data from the storage medium 118. Since the time to transform the data is typically 
less than the time to read the stored data from the storage medium 118, the conversion from one 
format to the other generally does not take longer than reading the stored data without any format 
conversion. Trieste of memory 114 needed to transform the data for a double.bufterlng scheme 
is bounded by twice the size of the largest band of the transformed image. 

According to another embodiment of the invention, an image can be transformed from one 
band structure format F\ to another band structure format F 2 . The method comprises the fol- 
lowing steps: 

a. Read as many bands of stored image data stored in the P x format as necessary to produce 
enough data to ftft a band in format F 2 . 

b. Convert the data fri format Fx to sequential format 

c. Convert the data in sequential format to format F 2 . Convert only as much data as necessary 
to produce an integral number of bands of format .Fj. 

d. Store the integral number of bands of F 2 on storage medium 118. 

e. Free the memory 114 of the integral number of bands In format F 2 . 

f . Return to step a. and continue until no more data is available. 

Fig. 6 Blustrates an example of the method- of transforming between two formats as 
described hereinabove. An Image 150 is stored In format F, whose band structure comprises 
equal bands of 100K pixels each. An image 152 is stored in format F 2 whose band structure 
comprises equal bands of 150K pixels each. To transform image 150 to image 152. the following 
steps are typically followed. 

1 . Read the first two bands B a and B b of image 150 and transform them Into sequential format. 

2. Transform the entirety of band B e and half of band B b into band from sequential format to 
format F 2 . 

3. Write band B , to image 152. 

4. Free the space fn memory 1 1 4 currently occupied by band B a and by the first hart of band B b . 

5. Read in band B e of image 150 and convert to sequential format. 

6. Transform the second half of band B b and the entirety of band B e Into band B 2 from 
sequential format to format F 2 . 

7. Write band B 7 to Image 152. 

8. Free up the space in memory 114 currently occupied by the second naff of band B b and by the 
entirety of band£,. 
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9. Repeat until no more data remains in image 150. 

The maximum space in memory 114 required for the method of converting between two for- 
mats described hereinabove, when using a double buffering scheme, is typically twice the sum of 
the band size required for each of the formats, ft is a feature of the invention that the pixels of 
image 1 50 are read only once. 

If the band structure of the two formats F x and F 2 are equivalent, the data can be easily 
transformed without first transforming the data into the sequential format The permutation is 
Ff t J>, where Pf\ is the transformation from format^ to sequential format and p Pt is the transfor- 
mation from sequential format to format F\. Alternatively, 9 the transformation between the two for- 
mats F x and F 2 is frequent, the permutation can be precomputed, thus reducing the complexity 
of the transformation and the time needed to execute the transformation. The maximum space in 
memory 114 required for this alternative method when using a double buffering scheme is typ- 
ically twice the size of the band. 

According to an embodiment of the present invention, the image data can be rotated at an 

known in the art. The tile transformation 
is described in the Pixar™ manual. Scope. Release U . Genera 7 J by The Graphics Division of Symbol- 
,cs ' nc - D - 70 2 ' ""k" 18 incorporated herein by reference. The tile transformation consecu- 
trvely stores pixels which are elements of a square section of the image in a single block on the 
storage medium 118. A tile of size «* comprises « rows of pixels each having « columns. Typically 
a tile will occupy a block. For a block size of 4096 bytes and pixels of 4 bytes each, a 32x32 tile is 
typically chosen. 

Fig. 7 illustrates the transformation for sequential format image 130 of Fig 2A. Shown are 5 
of the 12 4x4 tiles in which the first 192 pixels are stored. The first tile 160. comprising the first four 
pixels of the first four rows, is stored consecutively in an area of memory 114. The second file 
162.conprising the second four pixels of the first four rows, is stored after the end of the first tile 
160. Thus, if first tile 160 begins at memory location 0, then second tOe 162 begins at memory loca- 
tion 16. if pixels are stored in more than 1 memory location then the memory locations indicated is 
understood to be multiplied by the number of memory locations needed to store a pixel in actual 
memory address calculations. 

The permutation p for the abovementtoned example is given in equation 19. 

ft =/r O 0d« + H ^lj m0 d OT + „[-i-j] (19) 

Where m is the number of tiles In a row of the image. 

To rotate, by 90°. the image which Is stored in tile format a block size tile is read into a buffer 
of memory 114, moved to the block it will occupy when it is rotated, and then, rotated The 
operation is shown in Rg. 8. The operation can alternatively be performed in one read/write pass 
of the Image by reading a tile is read into a buffer of memory 114 and directly writing it to the 
corresponding destination rotated by 90°. This alternative method typically requires enough space 
m memory 114 to hold two tiles, the tile read in and the rotated tile. If double buffering is 
desired, to increase the speed of the computation, four buffers are typically allocated 
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According to a preferred embodiment ot the Invention, rotation at an arbitrary angle using a 
tile transformation can be performed. Rotation by 45°, being the rotation which typically uses the 
most buffer space m memory.114, is illustrated in Fig. 9 for an image organized Into a 5x5 tile for- 
mat. 

The fact that the resultant rotated image is non-rectangular is irrelevant to the current discus- 
sion. Well know techniques can be used to convert the rotated image to a rectangular form. For 
example, the rotated image can either be clipped to rectangular form, or expanded to contain the 
rotated image. 

For the example hi Fig 9, the rotation operation takes a 5x5 image 172, shown rotated th 
Fig. 9. rotates It and writes ft to storage 118 as a 5x5 image 174. The tiles of .source image 172 
are denoted with the double capital letters AA-YY, those of destination Image 174 are denoted with 
the double small letters aa-yy. image 172 is organized into bands 176, 178, 180. 182 and 184 
where each band comprises five tries. 

Typically a source image 172 file affects number of destination image 174 tiles This depen- 
dency Is denoted by fcp (a), where S is a set of destination Image 174 tiles and a is a set of source 
Image 172 tiles. For example, })={«} andl>(tBBJM«:^*fl. The function^ Is dependent 
on the details of the catcuratJon of each destination pixel since each destination pixel typically is 
dependent on a multiplicity of source image pixels. 

According to a preferred embodiment of the rotation operation tiles of source imaae 172 are 
buffered as follows. 

1 . Read Into memory 114 the first two rows of tiles from the source image 172. 

2. Read into memory 114 the next row of tiles from source Image 172. 

3. Calculate and write to destination image 174 all destination files that only dependent on the 
current three rows of source image 172 tOe. 

4. Free the memory occupied by the test recently read row of source Image 172 tiles. 

5. Repeat steps 2-4 until the entirety of the image has been written. 

An example of the abovementloned embodiment reads from the storage medium 118 bands of 
tiles labelled 176, 178. 180 from image 172 and writes out aO rotated tiles that are fully defined by 
the tiles of image 172 currently in memory 114. being tiles ec, dd, jj, «. a. oo. bb, hh, nn, and tt. The 
buffers for the first band of tiles 176 can then be freed and the band 182 read from the storage 
medium 118 into the location previously occupied by band 176. All previously unwritten rotated tiles 
that are fully defined py the unrelated tiles currently in memory 1 14. being tiles aal gg , nun, ss and vy 
are written to storage medium 118. The last recently unrelated band 178 Is freed and the next unrr> 
tated band 184 Is read in from storage medium 118. All previously unwritten rotated tiles that are 
fully defined by the unrotated tiles currently In memory 114, being tiles /. II, rr.xx.kk.qa ww DD w 
and uu, are written to storage medium 118. ' 

This procedure te summarized in Table 2. 

H should be appreciated that the only 3 bands of unrotated tiles need be stored in memory at 
any one time for any size image that is to be rotated and for any angle of rotation. This is because 
any destination fiiecan only be dependent on source tiles which span three sequential rows of tiles 
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Read and buffer tiles Discard tiles Write tiles 


AA,BB,CCJ)D£E 

FFfiGWJIJJ 
KK^LJdMffNjOO 










teMj)£cji % oo 
bbjthjmjt 




AAJtBjCCJDDJEE 




PP*QQMJSJT 














FFGGJWJIJJ 




UU,W,WWJX,YY 










jfjtljrjocjck 



The total memory 114 requirements for this method is 3 bands of tiles, to buffer the umotated ties 
plus one tile to hold the rotated tile. If double buffering is to be used the total memory 114 require 
merits is 4 bands of tiles to buffer the unrelated tiles, plus 2 tiles for the space to store rotated Hies 
before they are written to storage medium 118. 

An alternative embodiment of the rotation operation utilizes virtual memory to store the 
entirety of the rotated image 174. A Least Recently Used (LRU) page replacement policy 
causes the last three bands to remain resident in memory 114. If there are at least enough pages 
available to store 4 bands concurrently, on the order of 0(f) page faults typically occur, where /is 
the number of pages in the rotated image 172. Upon termination of the rotation of rotated image 
172, the entirety of the rotated image 172 is written to storage medium 118. Alternatively If the 
operating system of CPU 116 supports direct memory mapped disk files, the rotated image 'can be 
directly mapped to the virtual memory of CPU 116 and the rotated image written to storage 
medium 118 via standard virtual memory mechanisms. This alternative embodiment saves system 
swap area and the final writing of the image from virtual memory to the storage medium 118. 

According to an embodiment of the present invention, images stored in any band format can 
be rotated. The steps 1-6 are as follows. 

1 . Read in and convert to tile format a sufficient number of bands 122 of the image so that after 
conversion to tile format at least two bands of tiles are In memory. 
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2. Read in and convert to tile format a sufficient number of bands 122 of the image so that after 
conversion an additional band of tiles Is present in memory 

3. Calculate the entirety of rotated tiles that are only dependent on the converted three bands of 
annotated tiles. Write these tiles to a disk file in tile format 

4. Free the storage for the least recently read band of unrelated tiles. 

5. Repeat steps 2, 3 and 4 until the entirety of Image 120 has been read in and converted to tile 
format 

6. Use the method mentioned hereinabove to convert the rotated image currently stored on disk 
in tile format to a rotated image in the original band format 

ft should be noted that in the abovementioned rotation methods the image 120 is rotated by 
reading and wrfltng the entirety of two image-sized files. 

Reference is now made back to Fig. 1. The scanner 110 is connected to the scanner acquisi- 
tion unit 112 via a parallel interface, such as a Digital Equipment Corporation (DEC) DR11 interface 
defined by DEC and documented in the reference Microcomputer Interface Handbook. Digital Equip- 
ment Corporation. 1980. The CPU 116. memory 114 and scanner acquisition unit 112 are con- 
nected together on a CPU data and address buses 202. A similar CPU bus structure and DMA 
scheme is described In Intel technical manual 82380 High Performance 32-bit DMA Controller with 
Integrated System Support Peripherals, Me\ Corp 1988. As mentioned hereinabove, the system illus- 
trated In Fig. 1 fe a variant of standard DMA architectures. 

The system operates as follows: A NEW_DATA_READY One of the scanner 110 strobes 
Indicating to the scanner acquisition unit 112 that a valid pixel value /, (or a color separated 
pixel value representing one color of a color separated pixel) is available on the DATA lines of the 
scanner 110. Since there is typically no handshake between the scanner 110 and the scanner 
acquisition unit 112. the acquisition unit 112 must be able to receive the pixel value at a rate 
greater than or equal to the rate that the scanner 110 acquires the pixel value. 

Upon pulsation of the NEW_DATA_READYMe, the HOLD control line typically Is asserted, 
thus requesting control of the data and address buses 202 from the CPU 116. or other permanent 
bus master. 

When CPU 116 relinquishes control of the data and the address buses 202. it asserts the 
HLDA control Dne and enters a hold-state until the scanner acquisition unit 112 drives the HOLD 
signal false. 

With the HLDA signal asserted, the scanner acquisition unit 112 places an address on the 
address bus and the valid pixel value on the data bus 202. The address is the permuted memory 
location z, for the pixel value and Is calculated according to any of the methods of the present 
invention. The scanner acquisition unit 112 generates a memory write signal and the pixel value 
// is written to the proper address in memory 114. 

According to a preferred embodiment of the present invention, the permutations described 
hereinabove are implemented as address generator routines typically stored in the scanner 
acquisition unit 112 as microcode programs. The programs in Annex A and B are typically compiled 
into microcode to implement an address generator routine G(P). 
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in an alternative embodiment of the present invention the permutaUons are generated by 
precornputed lookup tables stored In ROM (read only memory) or lookup tables computed Just prior 
to the image acqu.sWon. The lookup tables are computed by the address generator routine 6(P) 

J i" apprecialed the address generator routine G(P) of the present invention is 
significantly different from those of standard DMA controllers which merely generate a new address 
by Incrementing the previous address by a predetermined value. 

»2^T^^r nto te tecatton inmemory ii4 « th * — 

Subsequently, the CPU 116 deasserts the HLDA signal and continues processing. The above 
£^^^T^*^™ ptal Vah,8/ '- ^ a band 122 ha^ been completely 

1,051112 tttefacttothe 

CPU 116 via the EOP signal wh.ch typically causes a CPU 116 Interrupt The CPU 116 then 
instructs the scanner acquisition unit 112. by writing to to or memory mapped registers on the 
scanner acqu^rbon unit 112, to switch the base address to a second buffer «LnJiu££. 

2Z E£i 7J". "? T r - ^ tend °' ^ — " in » e ™ «^?^Z 

storage medium 118 via the storage medium DMA controller 119, which may typically contain an 
82380 DMA controller from ,n»e. corporation. The storage medium DMaZKEE i S 
storage medium 118 are typically chosen to transfer the band of data at a faster rate thanTat bj 
which the scanner 110 acquires image data. Thus, the first buffer will be J&EtoSl 
second buffer is completely filled oerore me 

*h * Sh ^f* b9 H 016 * thal teChnlqUB M be modified for systems with more more 

than one DMA unit on the system bus. A bus arbitration protocol (for example daT Z 

sxss?* ^ 1 inswuted for - hold ^ *™xzsz?z 

It will be appreciated by persons skilled In the art that the present invention is not limited 
by what has been particularly shown and described hereinabove. The scope of the 0^ 
Invention is defined only by the claims which follow: P * 
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ANNEX A 

The following file named gabs .cc defties a base class gabs that is used in both Annex A 
and Annex B. 

1 // This file V? called gabs, cc 

2 // It is writen in the C++ langaage as describled in the book: 

3 // The C++ prograiiimlng language?' by Bjarne Stroustrup, 

4 // 1986, Adcfison-Wesley. 

5 class GABS { // Hie abstract class for reduction permutations 

6 protected:^ 

7 int lastj>tr ; 7 / The pointer to the begining of the last 

8 // abstracted block. 

9 int column; // The column in the image* 

10 int row_in_abs_image; // A flag to indicate when to go back to 

11 // the first abstraction. 

12 int ad; // Addressing within an abstracted band. 

13 int grow; // Flag to signify when to start a new 

14 // row in the abstracted band, Le. 

15 II after r image rows.. 

16 int inv_ad; // Addressing for inverse transformation 

17 int inv_cbunt ; // Counter to keep track of abstracted band 

18 int inv_rowcount; // Counter to keep track of which row we are in. 

19 int invj>tx; // The index of the current abstracted band. 

20 int n; // number of rows in each abstracted band. 

21 , int m ' : // rrty number of columns in each abstracted band 

22 int r; // r, order of the abstraction. 

23 int r2; ..." , 1 1 r % 

24 int b_size;' . // nmr 2 , size of band in pixels 

25 int phase; // The phase column. 

26 pixel** absjbasee; // Lookup table for abstract block addresses. 

27 pixel** iabs_i>ases; // Lookup table for inverse abstract block addresses* 

28 public: 

• 29 GABS (int nn, int mm, int rr) // A constructor for the GABS class. 

30 { 

31 n- nn; 

32 m— mm; 

33 r- rr; 

34 r2= r*r; 

35 b_size— n*m*r2; 

36 abs^bases- new pixel*[r2]; // The table size is r 2 . 

37 iabsjaases-. new pixel* [ r2 ] ; / / The table size is r 2 . 

38 init(); 

39 } 

40 // This is the part of the initialization that is repeated 

41 // For each band* 

42 void init() 

43 { 
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44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 



inv_ad- -r; 
inv_count= 0; 
inv_rowcount= 0; 
inv_ptr- 0; 
last_ptr= -1; 
column^ -1; 
pha8e= -1; 

row_in_abs_image= 0; 

ad=» 0; 

grow=0; 



> 



inline int band_size() // Return band size. 
{ 

return (b_size) ; 

> 

// The next function is called to generate the next 
// address when the next pixel value Is presented 
// by the scanner. 

pixel* next() { 
column++; 
phase++; 
last_ptr++; 
if (phase >- r) 
{ 

ad++; 
phase-* 0; 
last_ptr-= r; 

} 

if (column >» (r*xn) ) 



{ 



// Increment the current column. 
// Increment the current phase* 
// Increment to the next abstract block. . 
// The variance of phase within a row is r. 

// Reset the phase. 
// Jump back r abstracted blocks. 

// Are we at the end of a scanner row. 



column= 0; 
last_ptr+= r; 
row_in_abs_image++; 



// Reset column. 

// Jump forward r abstracted blocks. 
// We are now In the next row of abstracted blocks. 
//We have only nr rows of abstracted blocks. 
. // After each r scanner row jump the next row. 

if (row_xn_abs_image >- r) 



{ 



> 



row_in_abs_image= 0; 

last_ptr= 0; // Start again at abstract block zero. 



grow++; 



if (grow > 
{ 

grow»0; 



r) 



// Keep track of rows. 

// If we have read r rows go. 

// to next row in the abstract image. 



// Go to the next raw in the next abstracted band. 
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92 } 

93 else 

94 { 

95 ad— m; // Continue on the same row in the next abstracted band. 

96 } 

97 } 

98 // Return the sum of the abstract block pointer 

99 // and the addressing within the block. 

100 return (absjbases [last_ptr] + ad) ; 

101 } 

102 pixel* inext() { 

103 inv_ad+- r; 

104 if (inv_rowcount++ >- m) 

105 { 

106 inv_ad+« m*r*r - m*r; 

107 inv_rowcount= 1; 

108 } 

109 if (inv_count++ >- m*n) 

110 { 

111 inv_j>tr++; 

112 inv_ad- 0; 

113 inv_count~ 1; 

114 } 

115 return (iabsjbases [invptr] + inv ad) ; 

116 } 

117 // qa is the routine to compute the 

118 // addressing vdtfain an abstracted band 

119 int qa(infc- abs_col, int abs row) 

120 { " 

121 return (abs_col + abs_row*m) ; // Map pixels to sequential positions. 

122 } 

123 // qinvabs is the routine to compute the 

124 // inverse addressing within an ab^ 

125 int qainv(int abs_col, int abs row) 

126 { ~ 

127 return (r*abs_col + r2*m*abs row); 

128 } ~~ 
129 

130 // This routine computes the location of the abstracted band 

131 // having the phase <phase_row,phase_col) 

132 // This routine is overridden in the actual dass. 

133 // It is an error to call the qabs routine from 

134 // the dass GABS. 

135 virtual int q<abs(int phase_col, int phase_row) 
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137 { 

138 cerr « "Shouldn't get here"; 

139 } 
140 

141 // This routine computes the base location of first pixel of the abstracted 

142 // band having the phase (phase_row,phase_col) . 

143 // This routine is overridden in the actual class. 

144 // It is an error to call the qinvabs routine from 

145 // the class GABS • 

146 virtual int qinvabs (int phase_col, int phase row) 

147 { ~ 

148 cerr « "Shouldn't get here"; 

149 } 
150 

151 // Compute the mapping to abstracted format given a scanner row index. 

152 int q(int scanner_row_index) 

153 { 

154 // phase_col is the column phase of the pixeL 

155 // phase_row is the row phase of the pixeL 

156 // abs_col is the column number within the abstracted band. 

157 // abs_row is the row number within the abstracted band. 

158 int phase_col, phase_row, abs_col r abs_row; 

159 phase_col= scanner_row_index%r; ~~ 

160 phase_row» (scanner__row_index/ (r*m) ) %r; 

161 abs_col= scanner_row_index% (r*m) /r; 

162 abs_row= scanner_row_index/ (r2*m) ; 

163 // The mapping is the sum of the location of the abstracted band (qabs) 

164 // and the location with that abstracted band (qa) . 

165 return (m*n*qabs (phase_col, phase_row) + qa(abs_col, abs_row) ) ; 

166 } 
167 

168 // Compute the mapping to scanner row index given a abstracted format index 

169 int qinv(int abs_£ormat_index) 

170 { 

171 int phase__col, phase_row, abs_col, abs_row; 

172 phase_col- abs_f onnat_index% <r*m*n) / (m*n) ; 

173 phase_row= ab s_f onnat_±ndex / (r*m*n) ; 

174 abs_col= abs_f ormat_index%m; 

175 abs_row= (abs_f ormat_index% (m*n) ) /m; 

176 return (qinvabs (phase_col, phase row) + qainv(abs col, abs row))- 

177 } ~ " - 



178 }; 
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1 // ThisffleiscaDedga.ee 

2 #include <stream.h> 

3 #include "gabs. cc w // the file that defines class GABS 

4 // Class GA is derived from class GABS it defines an orderina 

5 // of the abstracted bands 

6 class GA: public GABS { 

7 ' public: 

8 // Initialize an instance of dassGA 

9 // The array abs_bases is a table that gives the 

10 // starting location of each abstracted band 

11 // Ibe array iabs_bases is a table that gives the 

12 // upper left hand comer of the abstracted band in the original band 

13 GA (pixel* offset, int nn, int mm, int rr) : GABS (nn,inra, rr) 

15 for (int i-0;i<r2;i++) 

16 { 

17 abs__bases[ij- offset + i*m*n; 
iabsjbases[i]- offset + i%r + r*m*(i/r); 



18 



19 } 

} ,f Note: the base address of the band in memory should be added to abs_bases 



20 
21 



22 // This defines the location of each abstracted band 

23 int qabs(int phase col, int phase row) 

24 { ~~ - 

25 return (phase_col + r*phase_row) ; 

26 } 



27 



28 // Inis defines the location of the first pixd of the indicated abstracted band 

29 int qinvabs (int phase col, int phase row) 

30 { ~ - 

31 return (phase col + m*r*phase row) : 

32 } ~ ~ 

33 }; 
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The following file named gatest.cc tests the class go. 

1 typedef char pixel; // Use an example 32 bits per pixel 

2 ^include "ga.cc" *^ 

4 £o ° ffSet; " aodd ^ inttofte b«^ofthebaiid buffer 

5 { 

1 fn^^' 3 ' 4 ' 4) '' //CTOtemi ^ ceofama PPi»g-a^nB«=3.«=3.r=4 
8 

// the i ddress g««rator and the mapping function return the 

// same address. The multiplication by the size of a pixel Is because * " 

// the generator returns addresses while the mapping functions returns 
±z 1 1 the permutation 

13 for(i- 0; i < ga.band_size () ; i++) 

14 { 

16 if(ga-next() != offset + ga.q(i)) 

17 cout « "Error in assertion: " « ±- 

18 } 

19 } 

20 // Reinitialize the instance of the mapping-generator 

21 ga.initO; 

24 for(i= 0; i < ga.band_size() ; i++) 

25 { 

26 // cout « int(ga.inextO) « " " « ga.qinv(i) « "O; 

27 if<ga.inext() !- offset + ga.qinv(i» 

28 { 

29 
30 

31 } 



34 
35 
36 



^ cout « "Error in inverse assertion: " « i ; 



32 // Reinitialize the instance of the mapping-generator 

33 ga.initO; 

// Check that the mapping function and the inverse mapping function 
// are m tact inverses of each other. 

for(i-0;i < ga.band size(); i++) 

37 { ~ 

38 int j; 

39 if ( i > - ga . qinv (ga . q ( i> ) ) / / Check that i=g- l (a(i)) 

40 cout « "Inversion error: " « i- 

41 } 

42 } 
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ANNEX B 

The following file named gm.cc defines a derived class of gabs called gm that Implements 
the multiple size reduction embodiment 

1 // This file is called gm. cc 

2 #include <stream.h> 

3 #include "gabs.cc" // the file that defines class GABS 

4 #include "cluster .hh n 

5 extern int mapping!]; 

6 static int* i mapping; 

7 // Class G5A is derived from class GABS it defines an ordering 

8 // of the abstracted bands' 

9 // This is the multiple order abstraction format 

10 class GM: public GABS { 

11 public: 

12 // Initialise an instance of class GM 

13 // The array aba bases is a table that gives the 

14 // starting location of each abstracted band 

15 // Hie array iabsjbases is a table that gives the 

16 // upper left hand corner of the abstracted band in the original band 

17 // We here take the specific case of r =60 and we execute the function 

18 // maO which defines the array mapping . 

19 GM (pixel* offset, int nn, int mm) : GABS (nn,mm f 60) 

20 { 

21 if (ca.startirrg_iocatidn — 0) 

22 ma(); 

23 imapping- new int [60*60]; // The inverse mapping 

24 for (int i-0;i<r2;i++) 

25 { 

26 absjbases [mapping [i]]= offset + i*m*n; ( 

27 iabs_bases[i]- offset + mapping [i]%r + r*m* (mapping [i] /r) ; 

28 imapping [mapping [i] ] « i; // Create inverse mapping array 

30 } 

31 // Hie function qabs and qinvabs are used in the generating functions. 

32 

33 // qabs defines the location of each abstracted band 

34 int qabs (int phase_col, int phase row) 

35 { 

36 return imapping [ (phase_col + r*phase row)]; 

37 } 
38 

39 // This defines the location of the first pixel of the indicated abstracted band 

40 int qinvabs (int phase_col, int phase row) 

41 { 
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42 int mapped_abs_band- m_:>ping[phase_col + r*phase row]; 

43 int true_phase_col» mapped_abs_band % r; ~ 
int true_phase_row- mappe d_ab s_band / r; 
rettirn (true_phase_col + m*r*true_phase row); 



44 
45 
46 
47 }; 
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The following file named set^hh defines the basic operations on sets. 

1 // This File contains support routines for the class AbsSet • 

2 // It uses the BitSet dass as described in the manual 

3 // "User's Guide to the GNU C^ Library" by Doug Lea. 

4 // CopyrigW 1988 Free Software Foundation.. 

5 // This library and the C++ cotnpDer can be obtained from the 

6 // Free Software Foundation, Ino, 675 Mass AVE, Cambridge, MA 02139. 

7 #include <BitSet.h> 

8 const int n- 60; 

9 // the function rc2can converts row, column coordinates to 

10 // canonical form. 

11 inline int rc2can(int r, int c) { return r + n * c; } 

12 class AbsSet 

13 { 

14 BitSet* bs; // This provides the bade Set functionality. 

15 int* ref_count; 

16 public: 

17 AbsSet (); j 

18 AbsSet (int, int -0, int -0); 

19 AbsSet : : AbsSet (BitSet &) ; 

20 "AbsSet () ; 

21 void operator - (AbsSet fi) ; 

22 AbsSet operator & (AbsSetfi x) ; 

23 AbsSet operator | (AbsSetfi x) ; 

24 AbsSet operator - (AbsSetfi x) ; 

25 void operator |- (AbsSetfi x) ; . 

26 int operator — - (AbsSetfi x) ; 

27 int operator !- (AbsSetfi x) ; 

28 int operator <« (AbsSetfi x) ; 

29 void set (int r, int c) { bs->set (rc2can(r, c)');} 

30 int count () { return bs->count (1) ; } 

31 cluster append < int *&) ; 

32 }; 



33 AbsSet: : AbsSet (int s, int r, int c) 

34 { 

35 bs- new BitSet; 

36 ref_count« new int; 

37 *ref_count- 1; 

38 for (int i-0;i<60;i+-s) 

39 for (int j~0; j<60; j+-s) 

40 set(i+r, j+c) ; 

41 } 



42 AbsSet : : AbsSet ( ) 
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43 { 

44 bs- new BitSet; 

45 ref_count= new int; 

46 *ref_count= 1; 

47 } 

48 AbsSet: : AbsSet (BitSetfi b) 

49 { 

50 bs= new BitSet (b) ; ; 

51 ref_count« new int; 

52 *re£_count~ 1; 

53 } 

54 AbsSet: :~AbsSet() 

55 { 

56 if (*ref_count — 1) 

57 delete bs; 

58 . else 

5 9 ( *ref _count ) — ; 

60 } 

61 void AbsSet :: operator « (AbsSetfi x) 

62 { 

63 if (*ref_count ==- 1) 

64 { 

65 delete bs; 

66 } 

67 else 

68 { 

69 *ref_count — ; 

70 } 

71 ( *x • ref _count ) ++; 

72 ref_count- x.ref_count; 

73 bs= x.bs; 

74 } 

75 AbsSet AbsSet :: operator & (AbsSetfi x) 

76 { 

77 return (AbsSet ((*bs) & *(x.bs))); 

78 } 



79 AbsSet AbsSet :: operator | (AbsSetfi x) 

80 { 

81 return (AbsSet ((*bs) | *(x.bs))); 

82 } 

83 AbsSet AbsSet :: operator - (AbsSetfi x) 

84 { 
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85 return (AbsSet ( (*bs) - * (x.bs) ) ) ; 

86 } 

87 int AbsSet: : operator —= (AbsSet& x) 

88 { 

89 return* <*bs) — *(x.bs}); 

90 } 



91 int AbsSet :: operator !■» ( AbsSet S x) 

92 { 

93 return((*bs) !- *(x.bs}); 

94 } 



95 int AbsSet: : operator <« (AbsSet & x) 

96 { 

97 return((*bs) <- *(x.bs))/ 

98 } 

99 void AbsSet :: operator |=> (AbsSetfi x) 

100 { 

101 *bs |«= *x.bs; 

102 } 

103 cluster AbsSet: : append (int*& ip) 

104 { 

105 cluster cl; 

106 cl.size_of_set- 0; 

10 7 cl . starting_locat ion- cl . total_size_of_sets ; 

108 for (int i- bs->first(); i >- 0; i-bs->next (i) ) 

109 { 

110 *ip++= i; 

HI cl.size_of_set++; 

112 } 

113 cl.totai < 8ize_of_sets+= cl.size_of_set; 

114 return cl; 

115 } 
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»™ TI 1k Allowing file named cluster.hh defines the data structure that allows the program to 
access the linear ordering of the setsS a , • • • ,s k . H'«u«aiu u> 

1 / / This defines the clustering of each set within the linear ordering of sets. 

2 struct cluster 

3 { 

4 static total_size_of_sets; // How big is the mapping so far. 

5 int s t art ing_lo cation; // mere does this cluster start. 

6 int size_of_set; // How big Is the set. 

7 } # 

8 extern cluster ca, cb, cc, cd, ce, cf, eg, ch, ci, cj, ck, cspl; 
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The following file named ma . cc calculates the subsets S at • • - ,S k . 

1 #include "cluster .hh" 

2 #include "set.hh" 

3 // This fraction creates the sets a-k. I also dusters the sets in the 

4 // order detailed in the example. 

5 int mapping [3600] ; 

6 cluster ca, cb, cc, cd f ce, cf f eg, ch f ci, cj, ck, cspl; 

7 ma() * 

8 { 

9 int *ip; 



10 // Create the set Si. 

11 AbsSet 3l(l) 

12 AbsSet s2(2) 

13 AbsSet s3(3) 

14 AbsSet s4(4) 

15 AbsSet s5(5) 

16 AbsSet s6(6> 



// S x 
// S 2 
// S 3 
// S 4 
II S 5 
// S 6 



17 AbsSet spl(((sl - s2) - s3) - s5) ; // S\ 

18 AbsSet a- s3 & s4 & s5; // The set 5 

19 AbsSet b» (s3 & s4) - s5; * 

20 AbsSet c« (s5 & s4) - s3; 

21 AbsSet d- (s4 - s5) - s3; 

22 AbsSet e- ( (s2 - s4> & s5) - s3; 

23 AbsSet f= ( (s2 - s4) & s3) - s5; 

24 AbsSet g- ( (s3 & s5) & s2) - s4; 

25 AbsSet h- (s3 & s5) - s2; 

26 AbsSet i- (s3- --82) - s5; 

27 AbsSet j- (s5 - s2) - s3; 

28 AbsSet k~ ( (s2 - s4) - s3) - s5; 

29 // The order of the sets a -tare as outlined in Fig. 4 

30 ip-mapping; 

31 cj- j. append (ip); 

32 ce- e . append ( ip ) ; 

33 ck- k. append (ip); 

34 cd=* d. append (ip) ; 

35 cc- c. append (ip) ; 

36 ca- a.append(ip) ; 

37 cb- b.append(ip) ; 

38 cf~ f .append(ip); 

39 cg= g.append(ip) ; 

40 ch« h. append (ip) ; 

41 ci- i. append (ip) ; 

42 cspl- spl. append ( ip ) ; 

43 } 
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The following file named gmtest.cc tests the class gm. 

1 typedef int pixel; // Use an example 32 bits per pixel 

2 # include "gnucc" 

3 const int nn= 1; 

4 const int 

5 pixel* offset; // Should point to the begining of the band buffer 

6 void is_scaled_image (pixel*, cluster**, int, int, int); 

7 main() 

8 { 

9 int j, i; 
10 

11 GM gm (offset, nn, mm); //Create an instance of a mapping havine n=l m=9 r=fin 

12 #ifdef NOCHECK ' 

13 / / Check that the address generator and the mapping function return the 

14 // same address. The multiplication by the size of a pixel is because 

15 // the generator returns addresses while the mapping functions returns 

16 // the permutation 

17 for(i«= 0; i < gm.band_size () ; i++) 

18 { 

19 if(gm.next() 1- offset + gm.q(i)) 

20 { 

21 cout « "Error in assertion: " « i; 

22 } 

23 } 

24 // Reinitialize the instance of the mapping-generator 

25 gm.initO; 

26 // Check that the inverse address generator and the inverse mapping function 

27 // return the same address. 

28 for(i= 0; i < gm.band_size() ; i++) 

29 { 

30 if (gm.inext () != offset + gm.qinv(i)) 

31 { 

32 cout « "Error in inverse assertion: " « i • 

33 } 

34 } 

35 // Reinitialize the instance of the mapping-generator 

36 gm.initO; 

37 // Check that the mapping function and the inverse mapping function 

38 // are in fact inverses of each other. 

39 for(i-0;i < gm.band_size() ; i++) 

40 { 

41 int j; 

42 if(i != gm.qinv(gm.q(i) )) // Check that i=q~ l {q(f)) 
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43 cout « "Inversion error: n « i; 

44 } 

45 #endif NOCHECK 



46 // Allocate room for a band 

47 pixel* image- new pixel[60*60*nn*xnmj ; 

48 GM gt (image, nn, mm); // Create an instance of a mapping with the base address image 

50 for(i-0;i < gtiband_size () ; i++) 

51 *gt.next()- i; // Write into the mapped band the pixel values 
5 * II in order to know what pixel it is take as the 

53 II pixel value its sequential location in the band 

54 // The following are the subset makeup of each abstraction. 

55 // It Is used to check that we can pull out an specific abstraction 

56 // from the band. See equation (7). 

57 cluster *d[]- { sea, scb, sec, scd, see, scf, scg, sen, 

58 *ci, scj, sck, scspl, 0}; 

59 cluster *c2[]- { sea, Scb, sec, Scd, See, scf, scg, sck, 0}; 

60 cluster *c3[]- { sea, Scb, Scf, scg, sen, sci, 0>; 

61 cluster *c4[] = { sea, Scb, sec, scd, 0}; 

62 cluster *c5[] = { sea, Sec, See, Scg, Sch, Scj, 0}; 

63 cluster *c6[]- { sea, Scb, scf, scg, 0); 

64 cluster *cl0[]- { sea, Sec, see, scg, 0}; 

65 // Check if the subset construction is correct 

66 is_scaled_image (image, cl, 1, nn, mm); 

67 is_scaled_image (image, c2, 2, nn, mm) ; 

68 is_scaled_image (image, c3, 3, nn, mm) ; 
is_scaled_image (image, c4, 4, nn, mm); 
is_scaled_image.(image, c5, 5, nn, mm) ; 

71 is_scaled_image (image, c6, 6, nn, mm) ; 

72 is_scaled_image (image, clO, 10, nn, mm) ; 

73 } 

74 // Check that the proper abstracted image can be extracted properly 

75 void is_scaled,lmage (pixel* pimage, cluster** pclusters, int divisor, 
/b int height, int width) 

77 { 

78 int i; 

79 int image_8ize»0; 

80 pixel* pp; 

81 while (*pclusters) 

82 { 

83 cluster* pc=> *pclusters; 

84 image_aize+= pc->size_of_set; 

85 pp- pimage + width * height * pc->starting_location; 

86 for(i-0; i < pc->size_of_set * height * width; i++) 



69 
70 
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87 { 

88 if((*pp++ % divisor) !- 0) 

89 cerr « "out of order " « divisor ; 

90 } 

91 pclusters++; 

92 } 

93 if (image_size !- 60*60/ (divisor*divisor> ) 

94 cerr « "Bad total size n « divisor; 

95 } 
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CLAIMS 

1. An image processir^ system comprising: 

image acquisition means for acquiring pixels of a digital image; 

permutation means for receiving said pixels subsequent to their acquisition by said 
Image acquisition means and for ordering said pixels thereby to reorder said digital 
image; and 

storage means for receiving and for storing said multiplicity of abstracted images. 

2. An image processing system comprising: 

image acquisition means tor acquiring pixels of a digital image; 

permutation means for receiving said pixels subsequent to their acquisition by said 
image acquisition means and for ordering said pixels thereby to reorder said digital 
image into a rrtuttipficfty.of abstracted images at a reduction factor; and 

storage means for receiving and for storing said multiplicity of abstracted images. 

3. An image processing system comprising: 

image acquisition means for acquiring pixels of a digital Image; 

permutation riieans for receiving said pixels subsequent to their acquisition by said 
image acquisition qaeans, for ordering said pixels thereby to reorder said digital image into a 
pluraBty of abstracted images at a relatively large reduction factor and for combining said 
abstracted images Into a multiplicity of sets of said abstracted images combinable into a plural- 
ity of arjstractedlirHgesataphjranty of different relatively small reduction factors; and 

storage means for receiving and for storing said digital image in said multiplicity of 

sets. 

4. An image processing system according to claim 1 and wherein said permutation means 
comprise means foi dividing said digital image into a plurality of bands comprising a 
predetermined number of rows of said digital image and means for operating on said plurality 
of bands In a band by band manner. 

5. An Image processing system according to claim 2 and wherein said permutation means 
comprise means for dividing said digital Image Into a plurality of bands comprising a 
predetermined number of rows of said digital image and means for operating on said plurality 
of bands in a band by band manner. 

6. An image processing system according to claim 3 and wherein said permutation means 
comprise means for divfdrng said digital Image into a plurality of bands comprising a 
predetermined rwirtiBT of rows of said digital image and means for operating on said pluraBty 
of bands in a band by band manner. 

7. An image processing system according to claim 4 and wherein said means for operating 
operate separately on each band. 

8. An image processing system according to claim 5 and wherein said means for operating 
operate separately on each band. 

9. An Image processing system according to claim 6 and wherein said means for operating 
operate separately on each band. 
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10. An Image processing system according to claim 7 and wherein portions of said bands are 
written by said means for operating to said storage means when said portions of said band fill 
at least one file system block. 

11. An image processing system according to claim 8 and wherein portions of said bands are 
written by said means for operating to said storage means when said portions of said band fin 
at least one file system block. 

12. An image processing system according to claim 9 and wherein portions of said bands are 
written by said means for operating to said storage means when said portions of said band fin 
at least one file system block. 

13. An Image processing method Including the steps of: 

acquiring pixels of a digital image; 

receiving said pixels subsequent to their acquisition in said step of acquiring and ord- 
ering said pixels thereby to reorder said digital Image Into a multiplicity of abstracted imaqes- 
and 

storing said multlpBcity of abstracted images. 

14. An image processing method including the steps of: 

acquiring pixels of a digital image; 

receiving said pixels subsequent to their acquisition in said step of acquiring and order- 
ing said pixels thereby to reorder said digital image Into a plurality of abstracted images at a 
relatively large reduction factor and combining said abstracted Images Into a multiplicity of 
sets of said abstracted images comblnable Into a plurality of abstracted images at a plurality 
of different relatively small reduction factors; and 

storing said digital image in said multiplicity of sets. 

15. An image processing method including the steps of : 

acquiring pixels of a digital image; 

ordering said pixels thereby to reorder said digital image into a multiplicity of abstracted 
images at a single reduction factor; and 

storing said multiplicity of abstracted images. 

1 6. An image transformation and rotation method including the steps of: 

receiving an image of a given image size stored in a permuted format; 

transforming said image to a tile format image via an inverse transformation of said per- 
muted format to a sequential format and via a forward transformation from said sequential 
format to said tile format; 

rotating said tile format image into a rotated tile format image by rotating the location 
of each tile of said image in said tile format, utilizing an amount of computer memory less than 
said image size; 

retransforming said rotated tile format image to a rotated permuted format Image via 
an inverse transformation from said tile format to said sequential format and via a for- 
ward transformation from said sequential format to said permuted format; and 

storing said rotated permuted format image, j 

17. An image transformation and rotation method according to claim 16 and wherein said step of 
rotation includes the steps of: 
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receiving and but ering a first number of tiles of a source Image to be rotated; 

writing to a storage medium a second number of tiles of a destination image, said 
second number of fifes being different from said first number of tiles, which second number of 
tiles are fully defined by rotations of said first number of tiles of a source image; and repeating 
said steps of receMng and writing until said source image no longer contains tiles. 

18. An image processing rotation method Including the steps of: 

receiving and buffering a first number of tiles of a source image to be rotated; 

writing to a storage medium a second number of tiles of a destination image, said 
second number of tiles being different from said first number of flies, which second number of 
tiles are fully defined by rotations of said first number of files of a source image; aril 

repeating said steps of receiving and writing until said source image no longer contains 

tiles. 

19. An image processing system comprising: 

image acquisition means for acquiring pixels of a digital image; 
means for drvkfing said digital image into a plurality of bands each comprising a 
predetermined number of rows; and 

permutation means for operating on said plurality of bands in a band by band manner 
and for reordering the location of said pixels; 

20. A system acconfng to claim 19 and also comprising storage means for receiving and for stor- 
ing said bands In a band by band manner. 
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